CLEF-IP 2010: Retrieval Experiments in the Intellectual Property Domain

In the recent decade that research in IR methods for Intellectual Property domain has increased. The rst e orts in observing how information retrieval is done in patent domain were done with the series of Nist workshops (see for example [2]). Lately, more workshops and conferences are dedicated to bringing together IR and IP specialists [3,8]. In 2008, the Irf obtained the agreement to coordinate two evaluation campaigns with emphasis on patent documents and prior art retrieval: Clef Ip and Trec Chem. The Clef Ip track was launched in 2009 to investigate IR techniques for patent retrieval and it was part of the CLEF 2009 evaluation campaign. In 2010, the track continued as a benchmarking activity of the Clef 2010 conference. The track utilizes a collection of more than 1.3 million patent documents derived from Epo (European Patent O ce) sources. The collection covers English, French and German with at least 150,000 documents in each language. There were two tasks in the 2010's track. The rst one is to nd patent documents that are candidates to constitute prior art for a given document. The second task is to classify a given document according to the International Patent Classi cation system (Ipc). Relevance judgements will be produced using the patent citations for the Prior Art Candidates search task and using the recorded classi cation codes for the Classi cation task. This notebook gives a report on the Clef Ip activity in 2010. The paper is structured as follows: Section 2 describes the test collection used this year, section 3 presents the participating teams and gives an overview of the methods the teams involved. In the same section we also present the main measurements done in this track.